Papers with Logic reasoning
DivLogicEval: A Framework for Benchmarking Logical Reasoning Evaluation in Large Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing logic reasoning benchmarks are limited in language diversity and their distributions are deviated from ideal distributions, which may lead to biased evaluation results. |
| Approach: | They propose a new logic benchmark DivLogicEval that uses natural sentences to evaluate logical reasoning . |
| Outcome: | The proposed evaluation metric mitigates bias and randomness inherent in LLMs. |